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@ Electronic filing systems and methods. 

@ An electronic filing system stores the contents of 
documents in an digital form and retrieves them as if 
they were arranged in an office, using a combination 
of a small display (1 ) and a position and orientation 
sensor (3). A simulated environment provides a natu- 
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ral interface for searching through complex informa- 
tion spaces. The display (1) and sensor (3) behave 
as a magnifying glass in either three-dimensional or 
two-dimensional space. 
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ELECTRONIC FILING SYSTEMS AND METHODS 



This invention relates to electronic filing sys- 
tenns and methods to facilitate the filing and retriev- 
ing of documents. 

Electronic filing systems which store docu- 
ments in digital form in optical or hard disc storage 
have been proposed to improve the office environ- 
ment. Such systems generally comprise a scanner 
to read documents, processing units to process 
infomiation from the documents in digital form, 
optical or hard discs to store the data, and a printer 
or other visual display. Well-structured documents 
can be organized in these systems through meth- 
ods such as categorization, addressing, and key 
work techniques. However, most documents in use 
in offices are still an-anged on an individual's desk. 
It would be beneficial to store and retrieve such 
documents by reference to a physical location. 

Interfacing in electronic filing systems is usu- 
ally done through a keyboard and display. In some 
cases the standard video display temninal is di- 
vided into partitions each representing a document. 
A pointer can be positioned in a particular position 
on the screen by use of a mouse oi' a joystick, and 
a document selected in that manner. The prior art 
systems suffer from one or more problems. Firstly, 
a standard video display terminal is a relatively 
large piece of equipment, designed to remain in a 
fixed position during use. Due to the nature of 
video display terminals, resolution is limited, and 
the temninal display area, also being limited, re- 
stricts the number of documents which can be 
represented on the screen for selection and re- 
trieval. Scrolling by activating a key on a keyboard 
is not desirable because it generally takes a long 
time to get to the desired position. 

Even in mouse systems, it is necessary to 
correlate the mouse movement to the movement 
on the screen, which can be difficult and unnatural 
when attempting to scroll through documents. US 
patent specification US-A-4 757 302 attempts to 
rectify this problem by the use of tactile feedback 
from the mouse to control the speed of paging and 
to provide a "feel" as each new page is displayed. 
However, a mouse cannot satisfactorily operate on 
a cluttered desk, and the use of a standard video 
display terminal has drawbacks discussed above. 

Another interface is known which can be ac- 
tivated by the movement of the user. It has been 
described in an article by James D. Foley pub- 
lished In Scientific American, Oct. 1987, pages 127 
to 135. It was developed by NASA AMES Research 
Center and utilizes an apparatus which one wears 
like a pair of eyeglasses. 

According to the present Invention there is - 
provided an electronic filing system for storing and 



retrieving documents converted into an electrical 

form, the system comprising: 

a combined display and position and orientation 

sensor; 

5 an absolute position calculator connected to re- 
ceive output signals from said sensor; 
a source of digitized video information and; 
a central processing unit for receiving the outputs 
from said source and from said absolute position 

w calculator, said central processing unit selectively 
providing a first output for supply to storage means 
and a second output for supply to a video memory 
unit, said video memory unit having an output 
connected to a scroll and zooming unit, which also 

15 receives an output from said sensor, and produces 
an output which is supplied to said display. 

According to the present invention there is also 
provided a method of storing and retrieving digital 
information data, said method comprising the steps 

20 of: 

producing an output data signal which is a function 
of data from a documentation to be stored; 
detemnining the position and orientation of a dis- 
play unit and providing a position signal which is 
25 indicative of said position and said orientation; 

processing said output data signal and said posi- 
tion signal for recording; 

writing data into a video memory unit showing 
there is a document at a determined position in a 

30 space; and 

scrolling and zooming data related to said position 
signal to provide a desired portion of the total data 
to be utilized within said video memory unit. 

An embodiment of the invention contains a 

35 display device and provides a simulated environ- 
ment or virtual world. The display unit does not 
require the eyeglasses apparatus, but utilizes a 
display and sensor apparatus to simulate a mag- 
nifying glass. The simulation may be of a desk or 

40 wall, for the storage and retrieval of documents, 
which makes possible the natural interaction of the 
user rather than the usual interface of a keyboard 
and video display terminal. It does not require a 
user to wear a somewhat cumbersome and unnatu- 

45 ral apparatus. 

Prior art systems can generally only store and 
retrieve documents effectively when the documents 
adhere to a well-structured format. 

Embodiments of the present invention can 

60 overcome these problems. The display unit can be 
substantially flat and much smaller than a video 
terminal, and as such it can be hand-held and 
readily moved like a magnifying glass. The Inher- 
ent limitation of screen size in prior art systems 
can be eliminated. The display becomes, for exam- 
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pie, the entire d sk top of documents, parts of 
which can be selectively viewed through the mag- 
nifying glass. Finding and retrieving information In 
stored documents is made easier becaus the doc- 
uments are stored according to a position in space. 
The positioning of the display unit is a natural and 
comfortable interface for a user, not only for the 
location of the documents, but also for the scrolling 
of the documents. 

Embodiments of the invention are capable of 
operation in a three-dimensional, as well as a two- 
dimensional, simulated environment. 

According to present invention there is also 
provided an electronic apparatus for storage and 
retrieval of information from documents in a digital 
form, comprising a combined display and position 
and orientation sensor providing associated output 
signals, an absolute position calculator connected 
to receive said output signals from said position 
and orientation sensor, a signal source of digitized 
video information, and a central processing unit for 
receiving the outputs from said position and ori- 
entation sensor, said central processing unit provid- 
ing a first output available for connection to storage 
means and a second output for connection to a 
video memory unit, said video memory unit having 
an output connected to a smooth scroll and zoom- 
ing unit, said scroll and zooming unit receiving an 
output from said position and orientation sensors 
and producing an output which is connected to 
said flat display. 

According to the present invention there is also 
provided a method of storing and retrieving digital 
information data, comprising the steps of providing 
documentation which is to be filed and retrieved, 
producing an output data signal which is a function 
of the data from the documentation to be stored, 
determining the position and orientation of a dis- 
play unit and providing a position signal which is 
indicative of said position and said orientation, pro- 
cessing said output data signal and position signal 
to effect recording, processing to write data into a 
video memory unit showing there is a document at 
the determined position in the space, and scrolling 
and zooming data related to the signal from ab- 
'solute position to provide a desired portion of the 
total data to be utilized within said video memory 
unit 

The small flat display can act like a magnifying 
glass to look at any very small document located in 
a simulated space such as a desk top or wall. Not 
many large documents can be placed on the re- 
stricted size of an office desk. Accordingly, in order 
to store many documents, they are reduc d in size. 
Conceptually, as in microfiche techniqu s, if one 
cuts microfiche into pieces so that each pag is a 
small individual piece and puts them at! on the 
desk or posts them on the wall, one can use a 
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magnifier to browse through them and to read 
them. It is this concept which is used in embodi- 
ments of the invention in electronic form. 

Embodiments of the invention can provide a 

5 natural user-friendly interface. They can be used 
not only with welhstructured documents, but also 
with unstructured documents to provide paperless 
offices. The ability to focus in as one would with a 
magnifying glass allows one to use a natural and 

10 easy to use interface. 

The invention will now be described by way of 
example with reference to the accompanying draw- 
ings, throughout which like parts are referred to by 
like references, and in which: 

75 Figure 1 is a perspective view of a display unit; 
and 

Figure 2 is a block diagram of the components 
of a system forming an embodiment of the 
invention. 

20 . A display unit 2 shown in Figure 1 comprises a 
flat display 1 and a position and orientation sensor 
3. A handle is is designed to be held by the user. 
A cable 5 to the display 1 and a cable 6 from the 
position and orientation sensor 3 are combined in a 

25 display unit cable 7. The display 1 can be a liquid 
crystal, plasma or similar display. 

The position and orientation sensor 3 is re- 
alized by utilizing a coil in a magnetic field (for 
example as described in Scientific American, Oct. 

30 1987. page 130), or ring laser gyros using known 
inertial navigation systems technology. A display 
driver provides power and control to the display 1 . 

Referring also to Figure 2, a video signal for 
the display 1 to enable visual reproduction of a 

35 document or part of a document is provided from 
the smooth scroll and zooming unit 9, which re- 
ferences the location in a video memory unit 12 
corresponding to the document or part of a docu- 
ment to be displayed. 

40 An absolute position calculator 10 calculates 

the position of the display unit 2 using the data 
from the position and orientation sensor 3. If the 
position and orientation sensor 3 is a gyro type 
sensor. like a ring laser gyro, and provides only the 

45 acceleration, the absolute position calculator 10 
calculates integrals of the data to derive the ab- 
solute position in space. An input device, for exam- 
ple, an image scanner 13 scans the documents like 
a photocopying machine and transforms the in- 

50 formation in the documents into digital signals and 
sends the data to a central processing unit (CPU) 
1 1 . The CPU 1 1 stores the data in a hard disc 1 5 
or an optical disc 16 to show the docum nt on the 
display 1, the CPU 11 sends the data to the video 

55 memory unit 12. To print th docum nt, th CPU 
1 1 sends th data to a print r 1 4. 

To register a document, the following process 
is utilized. The user scans the document through 

3 
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the image scanner 13, types it in, or obtains it from 
other sources such as another storage device or 
system. A title and/or keyword(s) can be added to 
it, and the digitized document is then stored on 
hard disc or an optical disc. Once the data are 
taken, the "user must specify the position for it in 
the simulated enviroriment or virtual world. The 
display unit 2 is moved to the desired position and 
the position is registered to hold that document. 
The absolute position calculator 10 sends the ab- 
solute position to the CPU 1 1 and stores the posi- 
tion data in association with the data of the regis- 
tered document. 

To look at the document, the user moves the 
display unit 2 iike one would a magnifying glass. If 
the position of the display unit 2 matches a position 
where a document was registered, the centre of the 
display 1 will show the document. The title of the 
document, the shape of the document, a rough 
sketch of the document or the full contents of the 
document can be displayed. In a preferred embodi- 
ment, the title of the document is shown first. In 
retrieval mode, the CPU 11 puts the titles of docu- 
ments in the video memory unit 12 at the cor- 
responding position. The scroll and zooming unit 9 
shows one portion of the area getting data from tlie 
video memory unit 12. 

To retrieve a document, it is necessary to 
move the display unit 2 to the position where the 
document had been registered in the simulated 
environment. As the display unit 2 is being moved 
into position, the titles of the documents are scrol- 
led on the display 1. When the display unit 2 is 
within a predetermined distance of the desired doc- 
ument position* the full content of the document is 
placed in the video memory unit 12 by the CPU 
11. The contents of the document can be scrolled 
in response to the movement of the display unit 2 
as one would do with a magnifier. In a preferred 
embodiment, as one approaches the desired docu- 
ment the title of the document will appear. Advan- 
cing the display unit 2 to the title causes the 
document to be opened to show the contents 
which can be scrolled as above. The display unit 2 
operates as an electronic magnifier in this way. 

In the second embodiment, a position sensor 
can be provided for the user to wear on his head. 
The sensor on the display unit 2 detects its ab- 
solute position and orientation. The other sensor, 
which is set on the user's head, is used to cal- 
culate the distance and the view angle between the 
user's head and the display unit 2. Using these 
data, the display unit 2 can show an aesthetic view 
as if it is a view with a magnifying glass in a 
simulated environment 

Since a magnifying glass has a fixed focal 
distance, it has an ar a which Is out of focus. In an 
embodiment of the Invention, this focusing is con- 



trolled according to the following scenario. 

The display unit 2 fcan be set in front of the 
eyes to see the whole scene. The user will see 
virtual documents on the desk or hung in strings in 

5 the room or on a wall. The display unit acts like a 
glass plate in this case. As the user walks towards 
the target object with the display unit in his hand, it 
acts iike a glass plate showing the target object 
growing larger. If the display unit 2 is moved away 

70 from or towards the user, the position is changed 
and the object enlarges or diminishes in size. In 
this manner, the display unit 2 acts like a magnify- 
ing glass. 

Responses to the movements of the magnify- 
75 ing glass are detennlned after modelling the par- 
ticular Information space required. An information 
space is very large and complex, and the filtering 
function must be incorporated to hide detail. In 
conceptual information space, scene detail has two 
20 meanings. One is the usual meaning; to see a 
smalt thing larger. The other is to see the detail of 
an object Zooming in on an Icon, for example, 
shows its contents, not an enlarged icon. In the 
context of this embodiment focus is used in its 
25 metaphorical sense to express the second type of 
detail. 

In this embodiment there are two ways to 
reach an object in detail. One is to walk toward the 
object The other is to adjust the display unit 2. 

30 The information level given by the latter approach 
is equivalent to that of the physical approach. 

It is known to use a "Rsheye L" approach In 
attempting to navigate large information spaces. 
This was described by G.W. Furnas in a publica- 

35 tion entitled "Generalized Rsheye Views" pub- 
lished in CHI '86 Conference Proceedings, Boston. 
MA, pages 16 to 23. This approach is limited only 
to the flat screen environment. Embodiments of the 
invention give the user a sense of moving in a real 

40 worid, because his motion generates magnifications 
of the screen environment Users will always see 
both a simulated environment in the display unit 2 
and the real physical world outside the display unit 
2. They can also move easily t>etween the detailed 

45 and overall view of their space in order to navigate 
to new areas. This allows them to use the context 
of the entire information space to locate them- 
selves. 

Although the concept is especially suitable for 
50 three-dimensional space, it can also be used in 
two-dimensional space as well. This would require 
the integration of the display unit and a mouse into 
one unit. This would be particularly useful in deal- 
ing with a very large spread sheet. 

55 

Claims 
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1. An electronic filing system for storing and re- 
trieving documents converted into an el ctrical 
form, the system comprising: 

a combined display (1) and position and orientation 
sensor (3); s 
an absolute position calculator (10) connected to 
receive output signals from said sensor (3); 
a source (13) of digitized video information; and 
a central processing unit (11) for receiving the 
output from said source (13) and from said ab- io 
solute position calculator (10), said central process- 
ing unit (11) selectively providing a first output for 
supply to storage means (15,16) and a second 
output for supply to a video memory unit (12). said 
video memory unit (12) having an output connected 75 
to a scroll and zooming unit (9). which also re- 
ceives an output from said sensor (3), and pro- 
duces an output which is supplied to said display 
(D- 

2. A method of storing and retrieving digital in- 20 
fonmation data, said method comprising the steps 

of: 

producing an output data signal which is a function 
of data from a documentation to be stored; 
determining the position and orientation of a dis- 25 
play unit (2) and providing a position signal which 
is indicative of said position, and said orientation; 
processing said output data signal and said posi- 
tion signal for recording; 

writing data into a video memory unit (12) showing 30 
there is a document at a determined position in a 
space; and scrolling and zooming data related to 
said position signal to provide a desired portion of 
the total data to be utilized within said video mem- 
ory unit (12). 35 
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© An electronic filing system stores the contents of 
documents in an digital form and retrieves them as if 
they were arranged in an office, using a combination 
of a small display (1) and a position and orientation 
sensor (3). A simulated environment provides a natu- 
ral interface for searching through complex informa- 
tion spaces. The display (1) and sensor (3) behave 
as a magnifying glass in either three-dimensional or 
two-dimensional space. 
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